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DETAILED ACTION 
Notice to Applicant 

1. Art Units 2611, 2614 and 2617 have changed to 2623. Please make all future 
correspondence indicate the new designation 2623. 

Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1, 3-7, 13, and 15-19 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Cragun (US 5,859, 662) in view of Barton (US 6,233,389). 

As regards Claims 1 and 13, Cragun discloses record/play apparatus and 
method for extracting and searching index information simultaneously from broadcast 
signals, comprising: a tuner for selecting a demanded channel from received broadcast 
signals (fig. 1.101 and col. 3, lines 57-64); a record control part for controlling 
storage/play of a media stream of a selected channel (fig. 2.207, fig. 2.208, and 2.210 
and col. 5, lines 11-29); an indexing engine for extracting index information from the 
media stream (in this case, the closed captioning converter extracts the closed 
captioning which is used to index the audio/video, fig: 1.103 and col. 4, lines 1-4); a 
storage device for storing the media stream inputted from the play control part and the 
index information extracted from the indexing engine (fig. 1.105 and cols. 5 and 16, 
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lines 26-48 and 6-9); a search/browsing engine (the computer, 1.105) for carrying out 
search/browsing in accordance with a non-linear multimedia access demand from a 
user using the stored index information (cols. 15 and 16, lines 60-67, 1-10, and 34-38); 
and a main control part (the CPU, 2.202) for controlling an entire flow of data and a 
control signal by receiving a command/control (such as from a keyboard or remote, 
cols. 4 and 5, lines 59-67 and 1-2) of the user and producing a required control signal 
(col. 4, lines 39-58). Cragun, however, fails to disclose an encoder for converting an 
analog stream or an uncompressed data stream into a compressed digital stream and 
outputting the compressed digital stream to the indexing engine and a storage control 
part for storing the compressed digital stream in the storage device. Barton does 
disclose an encoder (such as an MPEG encoder, fig. 1.101 and col. 3, lines 49-52) for 
converting an analog stream or an uncompressed data stream into a compressed digital 
stream (an MPEG-2 stream is a compressed digital stream) and outputting the 
compressed digital stream to the indexing engine (after encoding, the close captioning 
data is indexed to the audio and video streams to allow a variety of other processes, fig. 
12, col. 10, lines 32-52) and a storage control part for storing the compressed digital 
stream in the storage device (a hard disk, fig. 1.105, stores data in a digital form). 

At the time of the invention, it would have been obvious for one skilled in the art 
to combine the digital encoding and storage of Barton, an analogous art, with the 
indexing system of Cragun because digital storage is an increasingly popular way for a 
user to store audio video data. 
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As regards Claims 3 and 15, Cragun discloses the record/play apparatus and 
method of Claims 1 and 12 as well as that the main control part further comprises: an 
input interface for receiving an input of the user (figs. 2.204 and 2.205, cols. 4 and 5, 
lines 59-67 and 1-2); a controller for processing the index information and producing a 
control signal for required part in accordance with the index information and the input of 
the user when index information is inputted from an external source (fig. 2.202 and col. 
4, lines 39-58) (it is noted that control signal for storing the index information is 
produced based on extracting the index information and keywords input from the user 
[col. 2, lines 45-67]); a decoder for converting the stream stored in the storage device 
into a stream and outputting the stream (fig. 2.208, col. 15, lines 52-55); and a display 
control/interface for receiving the stream and transferring the stream (fig. 1 16, col. 15, 
lines 55-57) to a display device (fig. 1 .106). Cragun does not disclose converting the 
compressed stream stored in the storage device into an uncompressed stream and 
outputting the uncompressed stream; and a display control/interface for receiving the 
uncompressed stream and transferring the uncompressed stream to a display device. 
Barton discloses a decoder (an MPEG decoder) (col.4, line 6) for converting the 
compressed stream (such as an MPEG stream) stored in the storage device (see col. 3, 
lines 62-67 of Barton) into an uncompressed stream (such as an NTSC signal) (col. 4, 
lines 3-4) and outputting the uncompressed stream (such as an NTSC signal); and a 
display control/interface for receiving the uncompressed stream and transferring the 
uncompressed stream (see Cragun reference above) to a display device (see Cragun 
reference above). 
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At the time of invention, it would have been obvious to a person of ordinary skill 
in the art to provide the indexing system of Cragun with compression storage of Barton, 
an analogous art, for the benefit of providing compressed storage thereby maximizing 
storage efficiency. 

As regards Claims 4 and 16, Cragun discloses the apparatus and method of 
Claims 3 and 15 as well as the main control part (a CPU, fig. 2.202) and a separation 
module (fig. 1.102 and cols. 3 and 4, lines 64-67 and 1) for separating the index data 
from the media stream when the index information is inputted from the tuner with the 
media stream but does not disclose that the main control part comprises the separation 
module. The examiner hereby gives official notice that it would have been obvious at 
the time of invention to integrate the separation module with the main control part so as 
to make the apparatus more compact. 

As regards Claim 5 and 17, Barton discloses that the main control part, when a 
partially-compressed stream is required for the indexing engine, controls the record 
control part in a manner that the indexing engine is provided with the partially 
compressed stream (audio and video are compressed into MPEG while the information 
such as closed captioning is passed along, col. 3, lines 49-61, where it is later used for 
a variety of purposes, fig. 12, col. 10, lines 32-61). 

As regards Claims 6 and 18, Barton discloses that the main control part provides 
the indexing engine with an uncompressed stream by controlling the record control part. 
Indexing and editing in Barton is focused of the closed captioning information, fig. 12, 
col. 10, lines 45-52 and it does not matter if the audio and video data is compressed or 
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decompressed to make control decisions, such as switching audio tracks, col. 10, lines 
59-61. Therefore, feeding the indexing engine an uncompressed stream is an obvious 
variation of a partially compressed stream and it would have been obvious to one skilled 
in the art to do so, perhaps, to facilitate the process. 

As regards Claims 7 and 19, Cragun discloses that the index information 
extracted from the indexing engine is meaningful/structural/temporal information of 
multimedia content (col. 2, lines 33-38). 

Claims 8-12 and 20-24 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Cragun (5,859,662) in view of Barton (US 6,233,389) and in further 
view of Maybury (US 6,961 ,954). 

As regards Claims 8 and 20, Cragun and Barton jointly disclose the record/play 
apparatus and method of Claims 7 and 19 but does not disclose that the indexing 
engine, based on extracted index information, stores summary information, key frame 
information, key region information in connection with the entire temporal information. 
Maybury discloses that the indexing engine, based on extracted index information, 
stores summary information, key frame information (such as an imagery frame), key 
region (or, location) information in connection with the entire temporal information (col. 
4, lines 9-25). 

At the time of invention, it would have been obvious to a person of ordinary skill 
in the art to add the automated analysis system of Maybury, an analogous art, to the 
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keyword searching of Cragun and Barton because it gives the user added flexibility in 
searching content (Maybury, col. 2, lines 8-27 and 41-53). 

As regards Claims 9 and 21 , Maybury discloses that the meaningful information 
of the multimedia content extracted from the indexing engine is described in a manner 
that appearance and disappearance of an object, occurrence and end of an event (by 
dividing content into segments) (col. 4, lines 14-16), variance of setting (or places) (col. 
4, lines 16-20), state change of the object (a type of event cue) are connected to the 
temporal information (col. 4, lines 4-8). 

At the time of the invention, it would have been obvious to one skilled in the art to 
combine meaningful information of Maybury, an analogous art, with the indexing system 
of Cragun and Marbury because phenomena such as appearances of objects can 
signify important events to the user. 

As regards Claims 10 and 22, Maybury further discloses that the structural 
information of the multimedia content extracted from the indexing engine includes 
structural information of the multimedia stream such as scenes and shots (such as a 
single frame) (col. 4, lines 4-8). 

At the time of the invention, it would have been obvious to one skilled in the art to 
combine meaningful information of Maybury, an analogous art, with the indexing system 
of Cragun and Marbury because changes in scenes and shots can signify important 
events to the user. 

As regards Claims 1 1 and 23, Maybury further discloses wherein the 
search/browsing engine provides information required for the user to be able to select a 
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part to be transferred in the multimedia content stored in the storage device based on 
the index information (fig. 19 and col. 17, lines 25-37). 

At the time of the invention, it would have been obvious to one skilled in the art to 
combine meaningful information of Maybury, an analogous art, with the indexing system 
of Cragun and Marbury because storing searching information allows for easy retrieval 
of audio/video data. 

As regards Claims 12 and 24, Maybury further discloses wherein the 
search/browsing engine provides summary information of the multimedia content 
selected by the user based on the index information stored in the storage device (fig. 19 
and col. 17, lines 25-37). 

At the time of the invention, it would have been obvious to one skilled in the art to 
combine meaningful information of Maybury, an analogous art, with the indexing system 
of Cragun and Marbury because summary information allows the user to quickly grasp 
the content of the audio/video data. 

Conclusion 

3. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Cobbley (US 5,818,510) discloses a system for indexing 
broadcast information that includes segmentation, story summaries, and titles. Gupta 
(US 2005/0086703) discloses a method of indexing recorded programming that utilizes 
key frames and a table of contents. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to David R. O'Steen whose telephone number is 571-272- 
7931 . The examiner can normally be reached on 8:30 to 5. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Chris Grant can be reached on 571-272-7294. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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